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Abstract We introduce a vector differential operator P and a vector boundary operator B 
to derive a reproducing kernel along with its associated Hilbert space which is shown to be 
embedded in a classical Sobolev space. This reproducing kernel is a Green kernel of dif- 
ferential operator L := P* r P with homogeneous or nonhomogeneous boundary conditions 
given by B, where we ensure that the distributional adjoint operator P* of P is well-defined 
in the distributional sense. We represent the inner product of the reproducing-kernel Hilbert 
space in terms of the operators P and B. In addition, we find relationships for the eigen- 
functions and eigenvalues of the reproducing kernel and the operators with homogeneous 
or nonhomogeneous boundary conditions. These eigenfunctions and eigenvalues are used 
to compute a series expansion of the reproducing kernel and an orthonormal basis of the 
reproducing-kernel Hilbert space. Our theoretical results provide perhaps a more intuitive 
way of understanding what kind of functions are well approximated by the reproducing 
kernel-based interpolant to a given multivariate data sample. 

Keywords Green kernel • reproducing kernel • differential operator • boundary operator • 
eigenfunction • eigenvalue 
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1 Introduction 

The reproducing-kernel Hilbert space construction associates a positive definite kernel with 
a Hilbert space of functions often referred to as the native space of the kernel. This con- 
struction can be used to deal with the problem of reconstructing an unknown function which 
lies in the reproducing-kernel Hilbert space from a given multivariate data sample (see (9] 
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25 1) in an "optimal" way. Here this optimality can be quantified in terms of the norm in- 
duced by the Hilbert space inner product. It is therefore of importance to understand these 
spaces (and their inner products) as well as possible since such an understanding will pro- 
vide us with insight into the "correct" choice of kernel for any given application. Potential 
applications of kernel approximation methods can be found in an increasingly wider array 
of topics of which we mention only scattered data approximation [5 7,9 21 25], numerical 
solution of partial differential equations lf^l lT?ll 1 4- U 1 8 UT^ll 20 II 25 1 . statistical learning HH231 
l24l and engineering design 1151 . Future applications may see the combination of meshfree 
approximation methods and stochastic Kriging methods used within a common reproduc- 
ing kernel framework to approximate the numerical solution of stochastic partial differential 
equations (see, e.g., Ill 11 ). 

However, kernel approximation methods still face quite a few difficulties and challenges. 
Two important questions in need of a satisfactory answer are: What kind of functions belong 
to a given reproducing-kernel Hilbert space? and Which kernel function should we utilize 
for a particular application? Our recent paper 1101 establishes what kind of (full-space) 
Green function is a (conditionally) positive definite function and then shows how to embed 
its related reproducing kernel Hilbert space (or native space) into a generalized Sobolev 
space defined by a vector distributional operator P = (Pi, ■ ■ ■ , P n , ■ ■ ■ ) T . This construction 
results in an arguably more intuitive interpretation of the reproducing kernel Hilbert space 
associated with any given kernel. In some cases these two spaces are even shown to be 
equivalent. Our theoretical results produce a rule that allows us to determine which Green 
function can be used to approximate (well) an unknown smooth function. Conversely, we 
can use a Green function to formulate an interpolant for a corresponding class of smooth 
functions. The framework discussed in our earlier paper was restricted to full-space Green 
functions defined on the whole space R. rf , i.e., without taking into consideration the effect of 
boundary conditions. In the present paper we will show that the Green kernel derived using 
boundary conditions in a regular bounded open domain Q c Mr is a reproducing kernel and 
that its reproducing kernel Hilbert space is embedded in a classical Sobolev space. We begin 
by precisely defining what we mean in this paper by a function space being embedded in or 
being isomorphic to another space. 

Definition 1.1 (| 1„ Definition 1.25]) We say the normed space H is embedded in the normed 
space "H if H is a subspace of "H and the identity operator / : H — » is a bounded 
(continuous) operator, i.e., there is a positive constant C such that \\f\\<n < C||/||h for each 
/ e H c <H. In particular, if is also embedded in H then we say that H and are 
isomorphic, i.e., H = "H. 

Remark 1.1 Here equality of two function spaces, H = "H, means that H c W and "H c 
H only, i.e., we do not compare their norms. Unless specifically indicated otherwise, all 
functions discussed in this article are real-valued. 

We now present a standard Green kernel example from the theory of partial differential 
equations (see (8j Chapter 2.2]) to set the stage for our discussions later on. In order to 
solve Poisson's equation in the d-dimensional (d > 2) open unit ball Q = S(0, 1) = {x e 
K. d : \\x\\2 < 1} with (homogeneous) Dirichlet boundary condition, one constructs the Green 
kernel 

G(x,y) = <p(x - y) - <p(\\x\\iy - x), x,y e Q, 
of the Laplace operator L = —A = - Y, d j=\ J~i subject to the given boundary condition, i.e., 
for each fixed y e Q, we have G{-,y) e < H l (Q) (see Section [3TI below for the definition of 
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the classical L2-based Sobolev spaces f{ m (Q)) and 

LG(-,y) = S y , in Q, 
G(-,y) = 0, on dQ, 

where <fi is the fundamental solution of -A given by 

f-^loglWIa, d = 2, 

Just as in our discussion below, the Laplace operator L = —A = P* r P = -V r V can be 
computed using the gradient P = (Pi,-- - ,Pd) T = V = (gjjjv , a~) r ar >d its adjoint 
P* = (Pp ■ ■ ■ , P*) T = -V. With the help of Green's formulas [8 1 we can further check that 
the kernel G satisfies a reproducing property with respect to the gradient-semi-inner product, 
i.e., for all / e Cq(Q) and y e Q, we have 

{G(;y),f) v , Q = f PG(x,yfl>f(x)dx = Y f JL G (x,y)-?-f(x)Ax = f(y). 

JQ pf JQ OXj dXj 

However, this Green kernel G is not a reproducing kernel (cf . Definition 12.2b because G is 
singular along its diagonal, i.e., G(x, x) = oo for each x e Q. 

Therefore, it is our goal to show what kind of Green kernel is a reproducing kernel 
while maintaining a similar concept for the reproducing property. Our Green kernel will be 
associated with a differential operator L with homogeneous or nonhomogeneous boundary 
conditions (see Definition l4.1b , and the inner product of its reproducing-kernel Hilbert space 
will be represented through a vector differential operator P = (Pi, ■ ■ ■ ,P„,) T and a vector 
boundary operator B = (Pi,-- - ,B„ I: ) T , where the differential operators P ; : 1-i m (Q) — » 
L2(£?) and the boundary operators Bj : r H"'(Q) — » L,2(dQ) are bounded linear operators 
which are defined and discussed in Section[3] 

Because the Dirac delta function S y is a tempered distribution in the dual space 2>'(Q) of 
the test function space &(Q) (see Section [3Tb we shall extend the differential operators and 
their adjoint operators to distributional operators from 3$'{Q) into S$'(Q). Thus the differen- 
tial operator L can be represented by the vector differential operator P and its distributional 
adjoint operator P* via the formula L = P* r P = ^ > }^ > j- I n tms article, a differential 
operator P, its distributional adjoint operator P* and a boundary operator B are assumed to 
be linear with non-constant coefficients, i.e., 

P=YjP a °D a , P*= £(-l)l a lD«op a , 8= J] l^oflt, 

\a\<m \a\<m \fi\<m-\ 

where p a e C°°(fi), bp e C{dQ) and a,B e N d (see Definition l3Jl and Il3l 

Based on this construction we can establish a direct connection between Green kernels 
and reproducing kernels. We are also able to show how to use the differential operator P 
and boundary operator B to set up reproducing kernel Hilbert spaces which are embedded 
in classical Sobolev spaces (see Section[4]l. For example, Theorems 13.21 Corollary 13. II and 
Theorem 14. 5 1 allow us to arrive at a theorem such as 

Theorem 1.1 Let Q C R be a regular bounded open domain and introduce the vec- 
tor differential operator P = (Pi, ■ ■ ■ ,P„,,) r £ &"q and vector boundary operator B = 
(Pi, ■ • • , B„ b ) T G SS'q, where m > d/2 and m € N. Suppose that there is a Green kernel G 
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of L = P* r P = 2"=i with homogeneous boundary conditions given by B, i.e., for each 
fixed y e Q, we have G(-,y) e ( H m (Q) and 

LG(-,y) = 5 y , in Q, 
BG(-,y) = 0, ondQ. 

If the null space Null(P) := {/ G < H m {Q) : P/ = 0} is a finite-dimensional space, then the 
direct sum space 

n^(Q) = H°(£) e (Q) = {f = f P + f B : Bf P = 0, Pfy = 0, where f P , f B e <H"\Q)} 
equipped with the inner product 

(/>S)Hg( fl) = y Pjf(x)P j g{x)dx + Y J Bjf(x)Bjg{x)dS{x), f,geH*(fJ), 

' j=l ^ ® j=l ° 

is a reproducing-kernel Hilbert space whose reproducing kernel is a Green kernel K of L 
with boundary conditions given by B and \T(-,y) : y € Q] C ®"* jL2(i9i3), i.e., /or each fixed 
y eQ,we have K(-,y) e , H'"(^) anrf 

L^(-,j) = ^, 

B^(-, j) = r(-,j), on as, 

where the boundary conditions also satisfy \T(x, ■) : x 6 <5£?) C ®"* l Null(P). Moreover, the 

reproducing-kernel Hilbert space Hj^(£?) w embedded in the Sobolev space 1-{ m {Q) and the 
reproducing kernel K can be written in the explicit form 

K(x,y) = G(x,y) + J^if/ k (x)if/ k (y), x,y e Q, 

k=l 

where li/^l^j is an orthonormal basis of Null(P) with respect to the H-semi-inner product. 
(Here the classes 3^"j and SS"q are defined in Section\3\) 

Theorem 11.11 shows that the vector differential operator P and vector boundary operator 
B enable us to verify the reproducing property of the reproducing-kernel Hilbert space. This 
allows us to show that the Green kernel K becomes a reproducing kernel even with nonho- 
mogeneous boundary conditions, not just for the case of homogeneous boundary conditions. 
If Null(P) = {0) then K = G has homogeneous boundary conditions which implies that the 
reproducing property depends on P without having to resort to B - just as we had above 
for the case of the Poisson Green kernel. We can now reconsider the question of why the 
Poisson Green kernel above is not a reproducing kernel. Essentially this happens because 
m = 1 < d/2 so that the Sobolev embedding theory does not apply. On the other hand, 
Remark 14.11 gives us a counter example demonstrating that the Green kernel may not be a 
reproducing kernel even if it is uniformly continuous in the whole domain. 

In Section [4] we also consider the solution of eigenvalue problems via the method pre- 
sented in [3|, where the authors discuss how to find the eigenfunctions and eigenvalues of 
elliptic partial differential equations of order 2 with Dirichlet or Neumann boundary con- 
ditions. This will enable us to see the relationships between the eigenfunctions and eigen- 
values of Green kernels and those of differential operators L with homogeneous or nonho- 
mogeneous boundary conditions given by B. Propositions 14.21 and 14.61 allow us to transfer 
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eigenfimctions and eigenvalues from Green kernels to L and vice versa. We also use these 
eigenfunctions and eigenvalues to obtain the orthonormal basis of the reproducing-kernel 
Hilbert space and the explicit expansion of the Green kernel as, e.g., stated in Proposition l4.3l 
and |47] 

In Section[3J we demonstrate that many well-known reproducing kernels are also Green 
kernels. Examples include the min kernel and the univariate Sobolev spline kernel. We also 
construct other reproducing kernels that can be used in scattered data interpolation such as 
a modification of the thin-plate spline. 

In this article we limit our discussion of nonhomogeneous boundary conditions to those 
that are determined by a finite bases. However, all the theoretical results presented here can 
be extended to much more general nonhomogeneous boundary conditions constructed using 
a countable basis (see the Ph.D. thesis 1261 of the second author). Such Green kernels K can 
be seen as a reproducing kernel for the interpolation of multivariate scattered data obtained 
from an unknown function / e t H m (Q) at data sites X = {Xj}^ c Q. In a similar fashion as 
described in [9 23 25], we further obtain error bounds and optimal recovery properties for 
the interpolant s^ x = c jK('> x j) which satisfies the interpolation conditions Sfj[(Xj) = 
f(xj) for each j = 1, • ■ • ,N, 

2 Positive Definite Kernels and Reproducing-Kernel Hilbert Space 

We now provide a very brief summary of reproducing kernel Hilbert spaces. Much more 
background information can be found in, e.g., 1251 . 

Definition 2.1 ([25, Definition 6.24]) Let Q c R d . A symmetric kernel K : Q x Q -> R is 
called positive definite if, for all N e N, pairwise distinct points X := [xi, ... ,x N } c Q, and 
c := (ci, . . . , c N ) T G R N \ {0} the quadratic form 



If the quadratic form is only nonnegative, then the kernel K is said to be positive semi- 
definite. 

Definition 2.2 (|25, Definition 10.1]) Let Q c R d and U(Q) be a real Hilbert space of 
functions / : Q — » R. H(Q) is called a reproducing-kernel Hilbert space with a reproducing 
kernel K : Q x Q -» R if 

(0 K(-,y) 6 H(Q) and (it) f(y) = (K(-,y), /) H( fl), for all / e H(Q) and each y 6 Q. 

In order to formulate the following proposition which we will later use to verify some 
of our results on eigenfunctions and eigenvalues of a Green kernel we first consider a kernel 
K € L2(£? x Q) and define an integral operator I K q : L2(Q) — > L2(£?) via 



N 



N 




j=l k=l 




(2.1) 



Proposition 2.1 (| 25 , Proposition 10.28]) Suppose that the reproducing kernel K 6 L2(£?x 
Q) is a symmetric positive definite kernel on the compact set Q C R rf . Then the integral 
operator Ik,q maps h2(Q) continuously into the reproducing-kernel Hilbert space H(Q) 
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whose reproducing kernel is K. The operator Ik.q is the adjoint of the embedding operator 
of the reproducing-kernel Hilbert space H(Q) into h2(Q), i.e., it satisfies 



f. 

JQ 



f(x)g(x)dx = (f, I K ,ag)H(Q) , f e H(Q) and g e L 2 (Q). 
Moreover, r Range{I K q) = {Ik,q8 '■ g £ ^{Q)] is dense in H(Q) with respect to the H(£?)- 



3 Differential Operators and Boundary Operators 

3.1 Differential Operators and Distributional Adjoint Operators 

Our following proofs will rely on a number of basic concepts and techniques from the 
Schwartz theory of distributions (see Q , Chapter 1.5] and 1161 Chapter 1 and 2]). Of special 
importance is the notion of a distributional derivative of an integrable function. Distribu- 
tional derivatives are extensions of the standard partial derivatives 

d „ a{ d 

Da -=T]^> M:=YV, a:=(a u — ,a d )eN d . 

k=\ ° X k k=\ 

Let Q c R d be an open bounded domain (connected subset). We first introduce a test 
function space C ( ™(£?) which consists of all those functions in C^iQ) having compact sup- 
port in Q. [1 Chapter 1.5] states that the test function space C^{Q) can be given a locally 
convex topology and thereby becomes a topological vector space called &(Q). Note, how- 
ever, that 3>(Q) is not a normable space. 

Its dual space @'(Q) (the space of continuous functionals on 3>{Q)) is referred to as the 
space of tempered distributions. According to [16 Chapter 2.1], a distribution T e S>'(Q) is 
a linear form on 5${Q) such that for every compact set A c Q there exist a positive constant 
C and a nonnegative integer n e No such that 

T{y) <CV suplD^x)!, for each y e Cq(A) c &(Q). 

\a\<n xeA 

For example, the Dirac delta function (Dirac delta distribution) 6 y concentrated at the point 
y e Q is an element of 3>'{Q), i.e., (S y , j)q = y(y) for each y e 2>{Q). Our later proofs will 
make frequent use of the following two bilinear forms. We define a dual bilinear form 

(T, y) Q := T(y), for each T e &'{Q) and y e ®{Q\ 

and the usual integral bilinear form 

(f,g)a'.= I f(x)g(x)dx, where fg is integrable on Q. 

JQ 

1161 Chapter 1.5] shows that for each locally integrable function / e L'"'^) there exists a 
unique tempered distribution Tf e &'(Q) that links these two bilinear forms by the Riesz 
representation theorem, i.e., 



(Tf, y) a = (/, y) a , for each y e &(Q). 



(3.1) 
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Thus / € Lj (Q) can be viewed as an element of &'{Q) and Tf is frequently identified with 
/. This means that h'° c (Q) c 3)'(Q). 

Next we extend the standard derivative D a to the notion of a distributional derivative 
P a : &'(Q) — > &'(Q). This distributional derivative is well defined by 

{P a T,y) Q := (-l) a (T,D a y), for each T e 2>'{Q) andy e 

because D" is continuous from into &(Q) (see 1 16, Definition 3.1.1]). For convenience 
P" is also written as D a . 

Using this notion of distributional derivatives the real classical L2-based Sobolev space 
•H m (£) is defined by 

<H m (Q) := {/ e L[ oc (Q) : D"f e L 2 (Q), \a\ <m, a€ Nq}, me N , 

equipped with the natural inner product 

(f,g),„,o-= J] f D a f(x)D a g(x)dx, f,ge>H m (Q). 

\a\<m J Q 

Moreover, the completion of C™ (Q) with respect to the 7Y'"(fi)-norm is denoted by 9{q(Q), 
i.e., 'Hq(Q) is the closure of C™(fi) in < H" 1 (£?) as in Q. 

In the literature (see, e.g., [ 16 |) one also often finds differential operators written in the 
form p(;D)y = Z\ a \<mPaD a y, where p(x,y) := Z\ a \<m Pa(x)y a is a polynomial in y e R rf 
and Pq, € C°°(£?) (uniformly smooth functions space). The formal adjoint operator can be 
represented as p*(-,D)y = I lM < m (-l) ]a] D a (p a y). If p e C°°(5) then it can be seen as a 
distributional operator P p : &{Q) -> &'{Q), i.e., 

{P P T, y) := <r,py>, for each T e S>'(0) and y e ^(42), 

because y h-> py is continuous from $i{Q) into i^(£?) (see 1161 Definition 3.1.1]). Here we 
identify P p with p. Then this differential operator p(-,D) and its adjoint operator p*(-,D) : 
&{Q) —> 2$(Q) can be extended to distributional operators P, P* : &'(Q) — > &'{Q) similar 
as the distributional derivatives. To avoid any confusion with the symbols we will write 
PiPi =p°D a and P 2 Pj = D a o p where Pi = p and P 2 = D a . This means that 

poD a y = p(D a y), D a o py = (-1) H /J° (py) , yef(fl). 

Definition 3.1 A differential operator (with non-constant coefficients) P : &'(Q) — > 3i'{Q) 
is defined by 

p = V p „ o D", where p„ e C°°(Q) and a e Nq, m e N . 

|a|<w 

Its distributional adjoint operator P* : @ f {Q) — > ^\Q) is well-defined by 

P* = 2(-l) w ZJ°o P( ,. 

\a\<m 

We further denote its order by 

<9(P) := max {|a| : p a 2 0, \a\ < m, a e Nq) . 

A vector differential operator P := (Pi, ■ ■ • ,P„ t ) T is constructed using a finite number of 
differential operators Pi,--- ,P„ (i andits order 0(1*) := max{<3(Pi), • • ■ ,(9(P„ p )|. 
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After replacing the test function space S (metric space of rapidly decreasing functions 
in C°°(R d )) and tempered distribution space S' (dual space of S) in paper [ 101, the differ- 
ential operator P and its distributional adjoint operator P* have the same properties as 1101 
Definition 4.1], i.e., P\@(Q) and P*\@(Q) are continuous operators from 3i{Q) into @(Q) and 

(PT, y) a = (T, P'y) Q and (P'T, y) Q = (T, Py) a , for each T e <3'{0) and y e @{Q). 

Since Q is compact and C 0O (i2) c L2(Q), the differential operator P of order O(P) = m is 
a bounded linear operator from 9{ m (Q) into L2(£2). Its distributional adjoint operator P* : 
( H m [Q) — > L2(£2) is also bounded. So we can further use a vector differential operator P := 
(Pi, ■ • • , P„ P ) T of order m to define a P 'semi-inner product on ( H m (Q) via the form 

n p 

j=i 

Remark 3.1 Our distributional adjoint operator differs from the classical adjoint operator of 
a bounded operator defined in Hilbert space or Banach space. Our operator is defined in the 
dual space of 2>{Q) and it may not be continuous if the dual of 3$(Q) is defined by its natural 
topology. But the differential operator and its distributional adjoint operator are continuous 
when &'{Q) is given the weak-star topology as the dual of &{Q), i.e., 7* — > T in &'{Q) if 
and only if (T k , y) Q (T, y) Q for every y e @(Q) where [T k , T}™ =1 c &'{Q). 

When P = V = (^-, • • ■ ,-£^) T the P-semi-inner product is the same as the gradient- 
semi-inner product on the Sobolev space 'H l (£?). ThePoincare inequality 1 17, Theorem 12.77] 
states that the gradient-semi-norm is equivalent to the "H 1 (i3)-norm on the space *Hi (Q), i.e., 
there are two positive constants C\ and C2 such that 

CiWfWw < \f\v,a < C 2 \\f\\ w , f e 'Hq(Q). 

In order to prove a generalized Poincare (Sobolev) inequality for the Sobolev spaces 1-{ m {Q) 
we need to set up a special class of vector differential operators. 

Definition 3.2 ^™ is defined to be a collection of vector differential operators P = {P\ , ■ ■ ■ , P„ P ) T 
of order m e N which satisfy the requirements that for each fixed \a\ = m and a e Nq, there 
is an element Pj( a ) e {Pj}"'^ such that 

n(a) 

p m p m = (-ipir ° P \ ° D a + J] e;,.e„, ; , i < y(«) < n„, «(«) e n 0) 

i=l 

where p„ e C°°(i2) is positive in the whole domain Q and Q ai , Q* i = l,--- ,«(»), are 
differential operators and their distributional adjoint operators. 

Let's consider an example. If d = 2, then both vector differential operators Pi := 
(Pn,Pi2,Pi3) T = (|p V2^, J|) r and P 2 := P 2l = zl belong to 9* because 

PjjPn = D a o l o D a , where a = (2, 0), 
• ^2^12 = D° oloIT, where a = (1, 1), 
P* l3 Pi3 = D a o 1 o D a , where a = (0, 2), 
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and (using the definitions of P\ , just made) 

P* 21 p 2i = o i o d< 2 -°> + p* n p n + p; 3 p 13 , 

• P' 2l P 2l = £> (U) o 2 o D <u) + P* n Pu + P* u Pi3, 
P' 2l P 21 = D (a2) o 1 o D (a2) + P* n P u + P\ 2 Pn- 

Therefore we can verify that P^Pj = £y =1 p \j P \j = P* 2 Tp 2 = P* 2 \P2\ = A 1 . However, the 
null spaces of Pj and P2 are different, in fact Null(V\ ) g Null(P 2 ). 

The following lemma extends the Poincare inequality from the usual gradient semi-norm 
to more general P-semi norms and higher-order Sobolev norms. Since we could not find it 
anywhere in the literature we provide a proof. 

Lemma 3.1 If P e then there exist two positive constants C\ and C 2 such that 

CiH/Iko < l/|p >fl < C 2 ||/|| m , , fe<H%{Q). (3.2) 

Proof By the method of induction, we can easily check that the second inequality in ( 13.2b is 
true. We now verify the first inequality in Q.2t . Fixing any / e "H™(i3), there is a sequence 
\7k)T=i c so mat Ht* ~ f\\m,Q -» when k -> 00. Because of P e for each fixed 

\a\ = m and a e NjJ, there is an element Pj^ of P such that 

W p j(a)f \\l = (Pmf> p mf)a = Km{P m y k ,P m y k ) a = }im(P*P j(o) y k ,y k )a 

n(a) 

= lim((-l) w D a op* o D" r ,, r ,b + lim ViQl^m^a 

k — >oo k — »oo f i ' 

i=l 

n(a) 

= pxn(p a o D a y k ,p a o DPy k ) a + lim V(Q a ,in, Q a ,(Yk)a 

i=l 

"(a) 

= (p a o D<*/,p a o D<*/) fl + J](Q a jf, Q aJ fh > \\ Pa D a f\\l 

i=l 

> min\p a (x)\ 2 \\D a f\\ 2 Q . 

Since the uniformly continuous function p a is positive in the compact subset Q, we have 
min ;t(E Q|p Q ,(jt:)| > 0. Therefore, 

Cl J] \\D a f\\l < \f\i S2 , 

\a\=m 

where Cj, := n^tninjlpo^jc)! 2 . x € Q, \a\ = m, a e Nq} > 0. According to the Sobolev 
inequality [1 Theorem 4.31], there exists a positive constant Co such that 

C 2 D \\f\i, Q < J]\\D a f\\ 2 a , 

\a\=m 

By choosing C\ := CpCo > we complete the proof. 
□ 
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3.2 Boundary Operators 

In this section we wish to define boundary operators on the Sobolev spaces < H m (Q), m e N. 
Since these boundary operators can not be set up in an arbitrary bounded open domain, we 
will assume that Q c R rf is a regular bounded open domain (connected subset), e.g., it should 
satisfy a strong local Lipschitz condition or a uniform cone condition (see 1 1 , Chapter 4.1] 
and 1 17 Chapter 12. 10]). This means that Q has a regular boundary trace dQ. Moreover dQ 
is closed and bounded which implies that dQ is compact because the domain Q is open and 
bounded. 

We begin by defining special L2 spaces restricted to the boundary trace dQ as 
U(dQ) := 1/ : dQ -> R : \\f\\aa < °°) 
together with an inner product given by 

(f,8)aa:= f f(x)g(x)dS(x), fgeL 2 (dQ). 
Jsa 

Here J aQ f(x)dS (x) implies that / is integrable on the boundary trace dQ and dS is the 
surface area element whenever d > 2. In the special case d = 1 we interpret the restricted 
space as 

L 2 (dQ) := {f :dQ= {a, b) -> R} , 

and its inner product as 

if, g)ao = f(a)g(a) + f(b)g(b), f,ge L 2 (dQ), 

because the measure at the endpoints is defined as S (a) = S (b) = 1. 

The crucial ingredient that allows us to deal with boundary conditions will be a boundary 
trace mapping which restricts the derivative of an 1-{'"(Q) function to the boundary trace dQ. 
More precisely, for any fixed < m - I, ft e NjJ, we will define the boundary trace mapping 
of the h derivative Ffl and denote it by D^\aQ- We will now show that the operator D^\oq is 
a well-defined bounded linear operator from ( H m {Q') into LiidQ). 

When d = l we have Q := (a, b) and dQ := {a, b) with -00 < a < b < +00. According to 
the Sobolev embedding theorem (Rellich-Kondrachov theorem) 1 1 Theorem 6.3], "H'"(a, b) 
is embedded in C'" _l ([a, b]). In this special case the boundary trace mapping of the /? lh 
derivative Lf, lf\ aa : W'ia, b) L 2 (|a, b\\ is well-defined on , H m (a, b) via 

(D^kaMfKx) = DP f{x), f e ?T(a, b) and x e {a, b). 

In the case d > 2 a linear operator DP\qq : C m (Q) — > C(dQ) is well-defined by 

D^Uof ■= D0f\ go , f € C"'(Q). 

According to the boundary trace embedding theorem ([l, Theorem 5.36] and Il7l Theo- 
rem 12.76]) there is a constant Cp > such that 

WtffWaa < CpWlffh.a < C p \\f\\„ hQ , f e C\Q), 

which shows that lf\ a a is also a bounded operator from C m (Q) c "H'"(f2) into C(dQ) c 
L 2 (dQ). Since Q is assumed to be regular, C"'(Q) is dense in < H m (Q) with respect to the 
"H'"(Q)-norm by the density theorem for Sobolev spaces 1171 Theorem 12.69]. Therefore, 
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according to the bounded linear transformation theorem 1171 Theorem 5.19], D^\da has a 
unique bounded linear extension operator B 13 on ( H m (Q) such that 

BPf = DP\ aQ f = DPflgo, f e C m (Q) and \\BPfho < Cp\\f\\,„, Q , f e <H m (Q). 

We will call BP : 1-{ m (Q) — > L2(dQ) the boundary trace mapping of the B th derivative D 13 . 
We use the convention for the notations D^\sq same as BP in this article. 

Remark 3.2 The construction and definition of these boundary trace mappings are the same 
as in 111171 . In these references it is further shown that D^\ga is a surjective mapping from 
H m (G) onto <H"'-^- xll {dQ) whenever d > 2. However, we will not be concerned with the 
space ( H m " m ' 1/2 (dQ) in this paper. 

When d = 1 we also denote C(dQ) := {/ : dQ = [a,b] -> R}. So C(dQ) c L 2 (dQ) 
for every dimension deN which implies that bp o D^\gaf := bp(DP\aaf) e L2(<%2) when 
bp 6 C{dQ) and / 6 <H m (Q). Furthermore bp o BP\ aQ is continuous on f H m (Q). 

Definition 3.3 A boundary operator (with non-constant coefficients) B : 9-C n (Q) — » L2(<9£?) 
is well-defined by 

5 = V b p o E)P\ dQ , where fy, e C(dQ) and /? e Nq, mel. 

I8|<m-1 

The order of B is given by 

(9(B) := max [\B\ : bp * 0, |/8| < m - 1, B e Nq} . 

A vector boundary operator B = (Bi , ■ ■ ■ , B„ 4 ) r is formed using a finite number of boundary 
operators By ■ ■ ■ , B„ b and its order is (9(B) := max{(9(Bi), ■ ■ ■ ,0(B, Vi )}. 

We can use the vector boundary operator B = (By ■■• , B„ b ) T of order m - 1 to define a 
B-semi-inner product on 1-{'"(Q) via the form 

7=1 

Given a function / e "H 1 (Q), it is well known that / e "Hi (£?) if and only if / vanishes on 
its boundary trace. Therefore we need sufficiently many homogeneous boundary conditions 
to determine whether a function / e 7-{ m (Q) belongs to < H'^(Q). 

Definition 3.4 PJt" l } is defined to be a collection of vector boundary operators B = (By • ■ ■ , B„ b ) T 
of order m - 1 e No which satisfy the requirement that for each fixed / e < H m (Q) 

B/ = if and only if Jf\ dQ f = for each \B\<m-l and B 6 Nq. 

We illustrate Definition 13.41 with some examples for the set SS 2 Q in the case d = 1 with 
dQ := {0, 1}. Two possible members of .% > 2 Q are 

tM\ nr « _/ £\aa + Ado 



B, = K 1 ; or B, 



^Idfi I ~ \4r.\dQ-I\ 



\,i<> 



While these are both first-order vector boundary operators, their Bj and B2-semi-inner prod- 
ucts defined in r H 2 (Q) are different. 

Because of the trivial traces theorem [ 1 1 Theorem 5.37] we know that / e 'Hq(Q) if and 
only if DP\gof = for each \B\ < m- 1 and B 6 N{? whenever / e "H m (Q). In analogy to this, 
we can verify the same trivial trace property for the vector boundary operators B e SSq. 

Lemma 3.2 IfB e 3&», then f e -H m (i3) fee/cngs to ?^(jQ) i/awd owfy ifBf = 0. 
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3.3 Constructing Hilbert Spaces by Differential and Boundary Operators 

Let Q be a regular bounded open domain of K. d . We want to observe the relationship between 
our differential and boundary operators. Given a vector differential operator and a vector 
boundary operator, i.e., 

P = (p u . . . , p n f B = (5, , ■ ■ ■ , B„f 6 P£q, m > d/2 and m 6 N, 

the differential operator L of order 0{L) = 2m is well-defined by 

"p 

7=1 

Next we can construct homogeneous differential equations with respect to L and B in the 
Sobolev space 'H"'(£?), i.e., 

[hf = 0, in Q, 

1 J ' (3.3) 
Bf = 0, on dQ. 

Combining Equation d3 - 3 b and the following Lemma [3~3l we will be able to verify that the 
inner product spaces Hp(£?) and H^(Q) defined below are well-defined (see Definitions [3 
andll6l 



Lemma 3.3 Equation A3.3\) has the unique trivial solution f = in r H m (Q). 

Proof It is obvious that / = is a solution of Equation d3.3t . Suppose that / e 1-{'"{Q) is a 
solution of Equation lT53l , Since BeJJ and Bf = 0, Lemma [572] tells us that / e K^{Q). 
Thus there is a sequence ly/J^j c &(Q) such that Wy^ - f\\ m< a — > when /c — > <x>. And then, 
using the two bilinear forms introduced earlier, 



>>;/./';/>,. = Km )](!' J. P : y : u, = lim V {P)Pjf,y k ) a = \im{Lf,y k ) Q = 0. 

7=1 7=1 7=1 

Since P e ^J?, the generalized Sobolev inequality of Lemma l3.1l provides the estimate 
< \\f\tfi * c p\f\l,a = Cp Y)\Pjf\\l = 0, Cp > 0. 



IS- 



7=1 

This, however, implies that / = is the unique solution of Equation ( 13.3b . 
□ 

Note that in the above proof we employed both the integral and dual bilinear forms. 
Since we can only ensure that P'Pjf £ 9)'(Q), this quantity needs to be handled with the 
dual bilinear form. On the other hand, Pjf e Li{Q) implies that we can apply the integral 
bilinear form in this case. Using the notation introduced in I l3.lt . we therefore obtain that 

(Pjf,Pj7k)a = (Pjf,Pjyk)Q = (P*Pjf,7k)a because P j7k g &{Q). 

Definition 3.5 

H°(Q) := \f e <H m {Q) : Bf = 0} , 
and it is equipped with the inner product 

>h> 

Cf. 8MiQ) ■= (f, g)r,Q = J](P.if> PjSh, /. 8 e K( Q y 

7=1 
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We now show that the H p (£?)-inner product is well-defined. If/ 6 H p (£?) such that ||/|| H ll (fl) = 
0, then B/ = and ||P,/|b = 0, j = 1, ■ ■ ■ ,n p , which implies that 

tip n p tip 

(Lf, y) Q = Yj(P*Pjf, y)a = Yj {P i^ P ^ )q = Z (0 ' P ' r)fi = °' r e ^ Q) ' 

7=1 7=1 7=1 

Thus / solves Equation ( 13.3b and then Lemma [3~3l states that / = 0. 

Theorem 3.1 Hp(0) and'H™{Q) are isomorphic, and therefore Hp(Q) is a separable Hilbert 
space. 

Proof Because of Lemma [3~2l Hp(i2) = "H™(£?). The generalized Poincare (Sobolev) in- 
equality of Lemma 13.11 further shows that the Hp(Q)-norm and the "H"'(£?)-norm are equiv- 
alent on the space 'Hq(Q). 
□ 

In Section|4]we will establish relationships between H p (£?) and Green kernels with ho- 
mogeneous boundary conditions. Furthermore, we will consider Green kernels with non- 
homogeneous boundary conditions. To this end we need to define the inner product spaces 
Uf B {Q) defined below. 

Definition 3.6 Let the pair s/ := {41 k\ dk\"^' =x for some n a e No where {ak}" k " =1 c R + and 
WkYrL] C Null(L) := {/ e r H m (Q) : Lf = 0} is an orthonormal subset with respect to the 
B-semi-inner product, i.e., (i/y>, i///)b,q = a Kronecker delta function, k, I = 1, ■ ■ • ,n a . 
Denote that 

Hjf(£):= spanfi/r,,--- ,f Ha } 
and it is equipped with the inner-product 

k=l k 

where /. and gt are the Fourier coefficients of / and g for the given orthonormal subset, i.e., 

"<( ti a 
/ = 2j f^k, 8 = ^j Sk^k and {f k f^ v {gkf^\ c R - 

k=l k=l 

In particular, if n a = or s/ := {0; 0} then H^f(fi) := {0) and (0, 0) H ^ (fl) := 0. 

According to Lemma [331 the B-semi-inner product becomes an inner product on Null(L) 
which implies that the Hjj^ (£?)-inner product is well-defined. It is obvious that H^(Q) is 
a separable Hilbert space which is embedded in the Sobolev space , H'"(Q) because it is 
finite-dimensional. 

We have now finally arrived at the definition we will use in our construction of repro- 
ducing kernel Hilbert spaces connected to Green kernels with nonhomogeneous boundary 
conditions. 
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Definition 3.7 The direct sum space H^(Q) is denned as 

nf B (Q) := B° P (Q) e H^(fi), 
and it is equipped with the inner product 

(/> 8)u&(Q) ■= ifp, gp)H«(Q) + (fa, gBhgw f>8 e Hj^(Q), 
where f P , g P e H p (£}) and f B , g B e H^(Q) are the unique decompositions of /, g, i.e., 

f = fp + fn, g = gp + g B , where f P ,g P eH p (Q) and f B ,g B eH^(Q). 
The direct sum space Hp^(£?) is well-defined because H p (Q) n Null(L) = {0}. 
Theorem 3.2 Hp^(£?) w a separable Hilbert space and it is embedded in 1-{ m (Q). Moreover, 

(/. *)h£ (O) = (/> ^)P,A + Z " Z Z ^' )p ' fi ' * g £ H ™ (fi) ' 

ftr=l k k=\ 1=1 

where 

fk ■= (/, ^k)B,ao, gk ■= (g, ^k)n,8Q, k = 1, • • • , n a . 
/« particular, if = {>p k \ a k } n k " =l further satisfies \4i k } n k=l £ Null(V) then 

Proo/ Since H p (£?) and Hj^(£?) are separable Hilbert spaces which are embedded in < H m {Q), 
we can immediately verify that Hp^(Q) is a separable Hilbert space and that it is embedded 
in H m {Q). 

Fix any / = f P + f B e Uf B (Q), where f P e H°(£) and f B e Hjf (£). We immediately 
have B/ P = and Lf B = 0. Since f P e H p (Q) = ^{Q), there is a sequence \y k }™ = l c 2>(Q) 
such that Wjk - /p|| m ,a — » when A: — » oo. Thus we have 

(f B ,fph,a = lim y(Pjf B ,Pj7kh = lim Y^{Pjf B ,Pjy k )Q 

7=1 7=1 

= lim Y{P)Pjf B ,y k ) Q = }im(Lf B , 7k ) a = 0. 

7=1 

Because of B/ = B/p + B/ B = B/ B , we can compute the Fourier coefficients of f as, fa = 
(f,<l'k)B,dQ = (fB,>fk)B,dQ which implies that/ B = Z" k U fk^k and II/bII^ (0) = Z" k U o~ k l \f k \ 2 . 
Since 

ftp n a n Q np 

(f B , f B )v,Q = YfPjfB, PjfBh = £ Z ^< Z (P ^*' 

7=i *=i ;=i ;=i 

we have 

n a n a 

if, f)p,Q = ifp, fp)v,Q + 2(/ P , / B )p,fl + (f B , / B ) Pj fl = (/p, / P )p,fl + Z Z hfltyk, <A/)p,fl- 

k=l 1=1 
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Summarizing the above discussion, we obtain that 

□ 

We can also check that Hp^(£?) = *H™(0) ffi spanf^Jtp where the direct sum space is 
defined by the < H m (£?)-norm. 

Corollary 3.1 If Null(P) is finite-dimensional, then there is a pair .e/ as in Definition \3.6\ 
such that Hp^(£?) = 'Hq(Q) ffi Null(P) with its inner product equal to 

(/. £>Hg(fl) = (/- s)p,a + (/- g)n,ao> Hj^(fl). 

(Here the direct sum space 1i™(Q) ffi Null(P) is given the r H"'(Q)-norm.) 

Remark3.3 In |26] the finite pair srf = {^; a,kT{ = \ ls generalized to a countable pair = 
{f k \ a k \™ = , c A/wZZ(L) ® R + such that the Hp^(£) a "H m (Q). 

Corollary 3.2 ^'(Q) ffi M*ZZ(L) = ^ m (fl). 

To achieve the proof, we first show that Null(L) is complete with respect to the "?/'"(£?)- 
norm. For each / 6 < H m (Q) we can find its orthogonal projection f P in with respect 

to the P-semi-inner product. Finally, we can check that/ B := f-fp e Null(L). The complete 
proof is worked out in the thesis |26|. 



4 Constructing Reproducing Kernels via Green Kernels 

Let Q be a regular bounded open domain of R d . Given a vector differential operator P = 
(Pi,-- - , Pn p ) T 6 and a vector boundary operator B = (B\, ■ ■ ■ , B„ b ) T e SS'^, where 
m > d/2 and m e N, we want to find a Green kernel of the differential operator L = P* r P = 
Yi"j' = \ P*jPj w i m either homogeneous or nonhomogeneous boundary conditions given by B 
so that it is also the reproducing kernel of a reproducing-kernel Hilbert space. Furthermore, 
we assume that the pair := {ip k \ a k\" k c ' = \ c Null(L) ® R + satisfies the conditions of Defini- 
tion !3.6l such that {(Z^Jili i s an orthonormal subset with respect to the B-semi-inner product. 

In this section, we will show that the Green kernels with either homogeneous or nonho- 
mogeneous boundary conditions are reproducing kernels and that their reproducing-kernel 
Hilbert spaces can be represented by P, B and 

Definition 4.1 Suppose that the set Sf, := [T(-,y) : y e O] c ®"> 1 L 2 (d.Q). A kernel <t> : 
Q X Q — > R is called a Green kernel of L with boundary conditions given by B and 8& if for 
each fixed y e Q, <P(-, y) e Tl m (Q) is a solution of 

L0(-,y) = 5 y , in £?, 
B<Z>(-,}>) = IX-, y), ondQ. 

If ^ = {0), then the kernel G : Q x Q — > R is called a Green kernel of L with homogeneous 
boundary conditions given by B, i.e., for each fixed y e £?, G(-,j) e r H m (Q) is a solution of 

(LG(-,jO = 6 y , in Q, 
[BG(-,y) = 0, ondQ. 

(We can also use Lemma [331 to show that the Green kernel is a unique solution.) 
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Next we will view the relationship between the eigenvalues and eigenfunctions of the 
Green kernels (reproducing kernels) and those of the differential operators with either ho- 
mogeneous or nonhomogeneous boundary conditions. 

Definition 4.2 Let <5 e L 2 (Q x Q). {A p }™ c R and {e p }™ =l c L 2 (£)\{0} are called eigen- 
values and eigenfunctions of <I> if for each fixed peN, 

(l0,ae p )(y) = (®(-,y), e p ) Q = A p e p (y), y e Q, 

where I <t>,a is the integral operator defined in ( 12.1b . 

Definition 4.3 Let the set S := {J7 p }~ =1 Q ^f =l U.{dQ). {p P } p=l c R and {e p }™ =1 c ?/ m (£)\f0} 
are called eigenvalues and eigenfunctions of L with boundary conditions given by B and £ 
if for each fixed peNwe have 

\Le p = n p e p , in Q, 
I Be p = i] p , on dQ. 

\1S = {0}, then {^)™ =1 c R and {e p }J =] C "H m (£)\{0} are called eigenvalues and eigen- 
functions of L with homogeneous boundary conditions given by B, i.e., for each p e N 

Le p = [i p e p , in Q, 
Be p = 0, on dQ. 

The reader may be wondering about our use of different names for Green kernels. In 
the following we will use these different names to distinguish between a various types of 
Green kernels. The kernels G and K are defined in Theorems 14.11 and 14.51 and they are 
Green kernels with homogeneous and nonhomogeneous boundary conditions respectively. 
Moreover, a kernel R determined by the set srf is introduced in Theorem l4.4l We will verify 
below that K, G and R are reproducing kernels. Finally, we use the symbol <t> to denote the 
Green kernel corresponding to the general boundary conditions stated in Definition l4.ll The 
Green kernel <t> may not be a reproducing kernel. An example of such a typical case is given 
in Remark |4~T1 

4. 1 Green Kernels with Homogeneous Boundary Conditions 

Theorem 4.1 Suppose that there is a Green kernel G ofL with homogeneous boundary con- 
ditions given by B as in Definition \4.1\ Then G is the reproducing kernel of the reproducing- 
kernel Hilbert space H°(£) (see Definitional^ and H°(£) = <H%{Q). 

Proof According to Theorem[3j] H°(£) = 'H'^(Q). Fix any y e Q. Since G(-,y) e "H m (Q) 
and BG(-,y) = 0, we have G(-,y) e H£(0) by Lemmall2l 

We now verify the reproducing property of G. According to the Sobolev embedding 
theorem 1 1 1, *H"'(i2) is embedded into C{Q) when m > d/2, i.e., there is a positive constant 
C m such that 

||/|| c(5) := sup {|/(x)| : x e Q) < C, n \\f\\ m , Q , f e <H m (Q) c C(Q). 
For any fixed / e Hp(fi) there is a sequence {jk}™^ c &(Q) such that 

l/Cy)-nCy)l<ll/-nllc(5)^C ra ||/- rt ||,„,. Q ^0, when^^cx,. (4.1) 
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Since 

1p tip 

(G(;y),y k ) H ° {Q) = Yj(PjG(;y),P iyk ) Q = J](PjG(;y), P j7k ) Q 

7=1 7=1 

= 2(P*P J G(-,3'),r*>fl = {LG(-,y), n )a = {6 y ,y k )a = y k (y), k e . 

7=1 

we can determine that 

\(G(-,y),f)yo m - y k (y)\ = \(G(-,y), f) H o (Q) - (G(-,y),y k ) n o m \ 
<\\f-n\y p (a)\\G(;y)\y Tm < C P \\f-y k \\ m , B \\G(;y)\\ m , Q ^ 0, whenfc^ 



(4.2) 



where the positive constant Cp is independent of the function /. Here - as before - the 
two notations (•, -)q and (•, -)q denote the integral bilinear form and the dual bilinear form, 
respectively (see Section [3Tt . Combining Equations ( 14.1b and ( 14.2b . we will get 

(G(;y)J) HliQ) = f(y). 

a 

Corollary 4.1 G is a symmetric positive definite kernel on Q. 

Proof Fix any set of distinct points X = [x\, ■ ■ ■ ,x N ] c Q and coefficients c = (ci, • • • , c N ) T e 
R N , N e N. Since G is the reproducing kernel of the reproducing kernel Hilbert space Hp(Q), 
G is symmetric and positive semi-definite, i.e., 

N N N N N 

J]J] c j c kG(Xj,x k ) = (^c 7 G(-,JC / ),^c>G(-,jc i )) H °(f3) = llX c > G( '' JC ' :)|l H°(f3) - °- 

7=1 *=1 7=1 k=l j=l 

To get strict positive definiteness we assume Y, N j=\ c jG(-,Xj) = 0. For any y e S3(Q), 

N N N N 

2^Cjy(Xj) = ^ J c j (6 Xj ,y) Q = ^Cj(LG(-,Xj),y) a = (^ c > G(-,jc / ), r ) Pfl = 0. 

7=1 7=1 7=1 7=1 

To show that cj = 0, j = 1, • • • ,N, we pick an arbitrary x j e X and construct y j e &(Q) 
such that y j vanishes on X\{jc ; ), but yfycf) £ 0. Therefore 

JV N 

2^ / 1 CjC k G(Xj,x k ) > 0, when c # 0. 

7=1 k=l 



Since G(-,y) e C(Q) for each j e Q, G is uniformly continuous on which implies that 
G e L2(£2 x £?). According to Mercer's theorem (9] Theorem 13.5], there is an orthonormal 
basis {e p }™ =l of LjiQ) and a positive sequence {A p }™ =l such that G(x,y) = 2J=i ^-p e p(x)e p (y) 
and (G{-,y), e p )o = A p e p (y), x,y e Q, p e N. According to Proposition ^. II we can use the 
technology of the proof of 1251 Proposition 10.29] to verify { yfAj,e p }^ =l is an orthonormal 

basis of Hp(Q). (We firstly show that { yf^e p }^ =l is an orthonormal subset of Hp(Q). Next 
we can verify that it is complete.) 
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Proposition 4.2 If {A p )™ =l c R + and \e p }™ =l are the eigenvalues and eigenfunctions of G, 
then \A~ p \™_ x an d f e />l/T=i are tne eigenvalues and eigenfunctions of L with homogeneous 
boundary conditions given by B. Moreover, { -\flp e p}™ =l is an orthonormal basis ofHp(Q) 
whenever \e p }™ =l is an orthonormal basis o/L2(i3). 

Proof According to Fubini's theorem 1171 Theorem 12.41], for each fixed p e if and any 

y e @(Q\ 

{Le p ,y) Q = (e p ,L*y) Q = e p (y)(L* y)(y)&y 
Jq 

= f A-\G(;y),e p ) Q (L'y)(y)Ay = f f A- l G(x,y)e p (x)(L*y)(y)dxdy 
Jq Jq Jq 

= f A p 1 e p (x)(G(x,-),L*y) Q dx = f A~ p e p (x){G(-,x),L*y) Q dx 
Jq Ja 

= f A- 1 e p (x)(LG(;x),y) Q dx= f A~ l e p (x)(6 x ,y) Q 6x 
Jq Jq 

A~ 1 e p (x)y(x)dx = (A~ l e p ,y) Q . 

This shows that Le p = A~ p e p . 

According to Proposition ^. II the integral operator Iq,q is a continuous map from \-,j,{Q) 
to Hp(i3). Since A p e p (y) = (G{-,y),e p )Q = (Ia,Q e p)(y)^ J e we can conclude that e p e 
H°(Q). This implies that Be,, = 0, p e N. Therefore {A' 1 }^ and {e p }™ = j are the eigenvalues 
and eigenfunctions of L with homogeneous boundary conditions given by B. 
□ 

Proposition 4.3 If \p p }™_ l C R + and {e p }™ =l are the eigenvalues and eigenfunctions of 
L with homogeneous boundary conditions given by B, then [p,~ }^Lj and {e p }™ =l are the 
eigenvalues and eigenfunctions ofG. Moreover, if{e p )™_ x is an orthonormal basis ofl^ifl), 
then 

G(x,y) = ^p~ 1 e p (x)e p (y), x,y e Q. 
P =\ 

Proof According to Theorem l4.1I G is a reproducing kernel, i.e., we have 

(G(-,y), e p ) H o (B) = e p (y), y e Q, p e N. 
Applying the same method as in Equation (??), we obtain 

(G(-,y),e p ) H o (Q) = J^(PjG(-,y),Pje p ) Q = (G(-,y),p p e p ) Q . 

7=1 

Combining the above equations, we can easily verify that (G(-,y),e p )a = p~ p e p (y). The 
second claim follows immediately. 
□ 
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4.2 Green Kernels with Nonhomogeneous Boundary Conditions 

Theorem 4.4 The space Hjf (£) of Definition \3J>\ is a reproducing-kernel Hilbert space 
with reproducing kernel 

Ha 

R(x,y) := 2] a k i/f k (x)i/f k (y), x,y e Q. 

k=l 

In particular, when n a = or srf = {0; 0) then R : = 0. 

Proof We fix any yeQ.lt is obvious that R(-,y) = ZlU&kftkiyMk e Hjf (£). 

We now turn to the reproducing property. Let any / = jj., e Hjj^(£2). Then 

(R(.,jO, A^w, = £ = J/^Cv) = f(y), y e Q. 

k=i ° k k=i 

n 

Our main theorem now follows directly from Theorems l3.2ll4.l land l4.4l 

Theorem 4.5 Suppose that there is a Green kernel G ofL with homogeneous boundary con- 
ditions given by B. Then the direct sum space Hf B (Q) (see DefinitionUJi is a reproducing- 
kernel Hilbert space with reproducing kernel 

K(x,y):=G(x,y) + R{x,y), x,y 6 Q. 

Moreover, Hf B (Q) can be embedded into "H'"(£?). 

By Corollary 14.11 we know that G is a symmetric positive definite kernel, and using 
similar arguments we can check that R is symmetric positive semi-definite. Together, this 
allows us to formulate the following corollary. 

Corollary 4.2 K is a symmetric positive definite kernel on Q. 

On the other hand, K may not be positive definite on dQ (see the min kernel in Example l5.U . 
According to Definition al I we also have 

Corollary 4.3 Let Si := |B7?(-,j) : y e Q). Then K is a Green kernel of L with boundary 
conditions given by B and !%. 

Remark 4. 1 To see that not every Green kernel is a reproducing kernel, assume that <P is 
a Green kernel of the differential operator L. Then, according to Corollary 13.21 <T> can be 
uniquely written in the form 

<P(x,y) = P (x,y) + B (x,y), <P P (-,y) e <H£(Q), 4> B ( : ,y) e Null(L), x,y e Q. 

Therefore we have 

L0 P (-,y) = 6 V , in Q, (L& B (-,y) = 0, in Q, 

and < 

B0 P (-,y) = Q, ondQ, \B<P B (-, y) = B&(-,y), ondQ. 

This means that <P P is a Green kernel of L with homogeneous boundary conditions given 
by B. However, there may be no pair si such that R = <P B even though si is extended to 
a countable pair set. This shows that may not be a reproducing kernel of a reproducing- 
kernel Hilbert space. For example, <t>(x,y) := —\\x — y\ is the Green kernel of L := —4s. 
However, ip(x) := <£>{x, 0) is only a conditionally positive definite function of order one and 
therefore cannot be a reproducing kernel. 
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We are now ready to address nonhomogeneous boundary conditions. Consider a kernel 
r e \^2{dQ x Q). Then we can define an integral operator I r .a '■ ^i{£2) —* L2(dQ) via the 
form 

Hr,Qf){x) := (r(x, •), f)a, f e U(Q) and x e flQ. 

Let r denote the vector function T(-,y) = (Ti(-,y), ■ ■ ■ ,r„ h {-,y)) T '■= HK(-,y) for any 
y € Q, i.e., r ; (-,jO = BjK(-,y), j = 1, ■ ■ ■ ,n fc . Since BjG(-,y) =0jefl,we have 

r,0, j) = BjK(-,y) = BjG(-,y) + BjR(-,y) = BjR(-,y) = £ a k (Bjf k )f k (y). 

4=1 

As a consequence we have 7^- e L2(<%2 x £2). 

Proposition 4.6 {/l p }J =1 C R + and {e p }™ =l are the eigenvalues and eigenfunctions of 
K, then {A~ 1 }™_ 1 and {e p |™ =1 are the eigenvalues and eigenfunctions of L with boundary 
conditions given by B and 

s ■= lip ■= (Xp X I ri &e p , ■ ■ ■ ,X~pIr nb &e p ) T }™ =l , 

i.e., n p j(x) = A~ x (Tj(x, •), e p )a, x e dQ. Moreover, { ^X~ p e p}°^ =l is an orthonormal basis of 
Hpg(Q) whenever {e p }™ =l is an orthonormal basis ofh2(Q). 

Proof Using the same method as in the proof of Proposition l4.2l we can verify that (Le p , y)g = 
(A~ p e p ,y)a for each y e S>(Q). This implies that Le p = A~ l e p , p e N. 

Next we compute their boundary conditions. Fix any boundary operator Bj, j = 1, ■ ■ ■ , rij, 
and any eigenfunction e p and eigenvalue A p of K, p e N. Because K e C(Q x Q) is pos- 
itive definite. According to Mercer's Theorem, there exist an orthonormal basis [ipk) k= \ °f 
L2CQ) and a positive sequence {vi}^ such that K(x,y) = 2|fcLi VJtWtOOViGOj x,y e Q. 
We can also check that { -^Vk<Pk} k -i ls an orthonormal basis of H^(Q). Let K„(x,y) := 
ZLi veP&Ws), n £ N. Thus ijko.j) - £»<S30ll^ (o) = Zr=» + i v*l^00l 2 -» when 
n — > 00. According to Theorem 13.21 H^(Q) is embedded into 1-{ m {Q), which implies 
that \\K(-,y) - K„(-,y)\\ m , Q -» when n -» 00. So S^(-,j) = v^JJ^OWtGO and 
(Bj, x K(x, •), e p )fl = Zr=i n(Bj<Pk)(x)(<Pk, e p )a- It implies that 

Ap(Bje p Xx) = B M (K(x, ■), «„)fl = (S/,^(jc, •)■ = (r^x, •), e P )o, x e ao. 

It follows that the boundary conditions have the form Be ;7 = j/ for all p e N. 
□ 

Proposition 4.7 7f fjti^}™ =] c R + and {e ; ,}™ =l of\^2{Q) are ?/ie eigenvalues and eigenfunc- 
tions of L with boundary conditions given by B and 

S := {i] p := {p p Ir u Qe p , ■ ■ ■ ,MpIr H &e p f}p =1 , 

i.e., rj p j{x) = H P (Tj(x,-),e p )a, x e dQ, then {jUp 1 }^! cmd {e p \°^_ x are the eigenvalues and 
eigenfunctions of K. Moreover, if{e p }™ =l is an orthonormal basis ofh2(Q), then 

00 

K(x,y) = ^p~ l e p (x)e p (y), x,y 6 Q. 
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Proof We fix any p e N. Let v p (y) := p p (R(-,y), e p ) Q = fx p 2^ a t (^, e p ) a i/f k (y), y e Q. 
Then Lv ; , = and Bv p = 7/^ because HK(-,y) = HR(-,y) for each y e Q. 

Define u p := e p — v p , so that Lu p = Le p = p p e p and Bu p = Be p - Bu p = which implies 
that u p 6 Hp(i3). As in Proposition |43j we can obtain that 

(G(-,y),p p e p ) Q = (G(-,y), Lu p ) Q = (G(-,y), u p ) H o (Q) = u p (y), y e Q. 

It follows from the above discussion that 

(K{-,y), e p ) Q = (G(;y), e p ) Q + (R(-,y), e p ) Q = p p hi p (y) + p^v p (y) = pT p e p {y), y e Q. 

a 

Given a function / e WiQ), we also want to know whether / belongs to the repro- 
ducing kernel Hilbert space H^(Q) as used in Theorem 14.51 According to Corollary 13.21 
/ can be uniquely decomposed into f = fp + f B , where f P e H p (£?) and f B e Null{L). 
Theorem [33] shows that / e Hf B (Q) if and only if f B e H^(Q). Moreover, f B e Hjf (£) if 
and only if aj'l/tl 2 < 00 . where f k := (/, i/^B.da for each teN. 

Because 2t=i < 00 ■ ^ e can set ^;'(-* r >J') := B^ x Bj y R{x,y), x,y e <%2 and 
7 = 1, • • ■ Then Wj(x,y) = Ylk = \ ®k(B ji//k)(x)(B jif/^ty) which implies that each Wj is 
symmetric positive semi-definite on dQ. So Wj is the reproducing kernel of a reproducing- 
kernel Hilbert space Hj(dQ) by [4, Theorem 1.3.3]. According to |25 Theorem 10.29], we 
have ££Lj cT k x \f k \ 2 < 00 if and only if Bjf e H,(5D), 7 = 1, ■ ■ ■ , 

Theorem 4.8 Let Wj(x,y) := B hx BjjR(x,y), x,y e dQ and j = l,--- ,n b . Use Kj(dQ) 
to denote the reproducing-kernel Hilbert space whose reproducing kernel is Wj. Then a 
function f 6 "H'"(£?) belongs to Hp^(£?) if and only if Bjf £ Hj(dQ) for each j = l, ■ ■ ■ , n b . 

Remark 4.2 In Remark [3~3l we mentioned that the nonhomogeneous boundary conditions 
discussed in the present paper can be generalized to such that are generated by a countable 
set s/. One will also want to know which Green kernels associated with such nonhomoge- 
neous boundary conditions are reproducing kernels. In the thesis [26] it is shown that, e.g., 
a Green kernel e ( H* nfn (Q x Q) is a reproducing kernel if and only if Bj X Bj y <t> is positive 
semi-definite on dQ for each j = 1, • • • , n\j. This Green kernel can then be expanded as the 
sum of eigenvalues and eigenfunctions analogous to Propositions 14.61 and 14.71 This allows 
us to approximate the interpolant s/pc by a truncated expansion of the Green kernel. 



5 Examples 

Example 5.1 (Modifications of the Min Kernel) Let 

Q := (0, 1), P := L := P\P X = - J^, B := I\ da = I\ mi . 

It is easy to check that P e &> X Q and B e SS l Q , where 0(P) = 0(B) + 1 = 1 > 1/2. We can 
calculate the Green kernel G of L with homogeneous boundary conditions given by B, i.e., 



G(x,y) := min{ x, y) — xy, x,y e Q. 



22 



This Green kernel G is also known to be the covariance kernel of the Brownian bridge. 
According to Theorem 14.11 G is the reproducing kernel of the reproducing-kernel Hilbert 
space 

H°(fl) = {/ e 'H 1 (£3) : /(0) = /(l) = o} ss <H^Q), 
with the inner product 

(f,8)B0 i a ) = (J,8)v^ = (f',g')Q= f f(x)g'(x)dx, f,geU°(Q). 

Jo 

In order to obtain a second, related, kernel we consider the same differential operator 
with a different set of nonhomogeneous boundary conditions. One of the obvious orthonor- 
mal subsets of Null(L) = span{i/ri, 1^2 1 with respect to the B-semi-inner product is given 
by 

ip\{x) := x, tyjix) := 1 — jc, x E Q, 
and we can further obtain that 

fx ■= (/, i/nhjsa = mi h ■= if, *2h,aa = /(0), / e <H\Q). 
We will choose the nonnegative coefficients 

«i := 1, 02 := 0, 

to set up the pair nt := aj}? =1 . According to Theorems l4.4l andl 4.5l the covariance kernel 
of the standard Brownian motion 

K(x,y) = G(x,y) + R(x,y) = G{x,y) + ai\j/\(x)\j/\(y) = mm{x,y}, x,y e Q, 
is the reproducing kernel of the reproducing-kernel Hilbert space 

Hg(fl) = H° p (Q) e Hjf (O) = H°(£) © spanji/r,! = {/ e : /(0) = 0}, 

with the inner product 

(f,gh"<p) = (f>g)p# + — -/ili(^.^i)p,fi= f /W(*)d*, /,geH*J(fl). 
PB «i Jo 

If we select another pair i.e., 

V2 r- V2 

<AiW := — , w) := V2x-— , «i := 1, a 2 := 0, 

then we can deal with periodic boundary conditions. Thus we obtain the reproducing-kernel 
Hilbert space 

nf B (Q) = H° P (Q) ® Null(P) = H°p(Q) ffi span^) = {/ e "H l {Q) : /(0) = /(l)} 
equipped with the inner product 

(f, gham = <f> tk* + C/. *>mq = f /W«d* + /(0)g(0) + /(i)g(i), 

Jo 

whose reproducing kernel has the form 

K(x,y) := G(x,y) + aiifri(x)ifri(y) = min{x,y} - xy + -, x,y e Q. 
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Example 5.2 (Univariate Sobolev Splines) Let cr be a positive scaling parameter and 

d 2 d 2 

0:=(O,1), P:=(— ,cr/) r , L a :=Y j P*Pj = -—+ C r 2 I, B := I\ gQ . 

;'=i 

Then P e and B 6 So the Green kernel of with homogeneous boundary 
conditions given by B has the form 



Ga-(x,y) 



o-Jh^) sinh(o\x) sinh(<x - cry), 0<x<y<\, 
o-Jh^) sinh(cr - crx) sinh(cry), < y < x < 1 . 



Using the same approach as in Example 15.11 we can pick an orthonormal bases of 
Null(L) with respect to the B-semi-inner product as 

exp(cr - crx) exp(crjt) 



V2(exp(o-)-l) V2(exp(o-)-l) 

exp(cr - crx) exp(crjt) 
if/ 2 {x) := — =- + 



V2 (exp(cr) + 1 ) V2 (exp(cr) + 1 ) ' 
and then compute 

fx ■= (f, ^)bmq = "4 (/(0) " /(I)) , h ■= (L ^i\as = 4= Cf(0) + /(D) ■ 

We further choose the positive sequence 

exp(cr) - 1 exp(cr) + 1 

a\ := , a2 := . 

2cr exp(cr) 2cr exp(tr) 

According to Theorem l4.5l 

#0, y) = Go-Oc, y) + y) = G a (x, y) + V a k il/ k {x)ip k (y) = — exp (-ct|j: - y\) 

is the reproducing kernel of the reproducing-kernel Hilbert space H^(Q) = 'H 1 (Q) with the 
inner-product 

Cf. g~)n%(0) = f f\x)g'(x)dx + cr 2 f f(x)g(x)dx + 2cr/(0)g(0) + 2cr/(l)g(l). 

PB Jo Jo 

Remark 5.1 Roughly speaking, the differential operator L a = —-j^ + a 2 1 converges to the 
operator L = — jj-j from Example 15 . 1 1 when cr — > 0. We also observe that the homogeneous 
Green kernel Go- of converges uniformly to the homogeneous Green kernel G of L when 
cr —> 0. This matter is discussed in detail for radial kernels of even smoothness orders in the 
paper [22|. One might hope to exploit this limiting behavior to stabilize the positive definite 
interpolation matrix corresponding to Go- when cr is small by augmenting the matrix with 
polynomial blocks that correspond to the better-conditioned limiting kernel G. 
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Example 5.3 (Modifications of Thin Plate Splines) Let Q := (0, l) 2 C K 2 and 
q2 q2 q2 d d 

dx\ dxidx 2 dx l 2 dx\ dx 2 

which shows that P e and B e PJp- Q . Thus we can compute that 

3 

We know that the fundamental solution of L is given by 

1 9 o 

|| r l|2 1„„||„|| „ r- TDiZ 



<x) := — IWIjloglWb, xe : 



i.e., Lfi = 5q in R 2 . Applying Green's formulas, we can find a corrector function $ e < H 1 (Q) 
for each fixed j e £? by solving 

Lf = A 2 f = 0, in O, 
=T(-,y), on 30, 

whMeACr.jr) := ^(21og||x-jr|| 2 + l)(*i -yi),r 2 (x,j) := ^(21og||x-j;|| 2 + l)(x 2 -;y 2 ) 
and rj,(x,y) := ^||x - j^|[|log||x -J>[| 2 . Since r(x,j>) = B^x — y) for each x e dQ and 
y e Q, the kernel G(x, j>) := 0(x - _y) - if(x) defined in Q x Q is a Green kernel of L with 
homogeneous boundary conditions given by B. 

Since A/m//(P) = tti(Q), the space of linear polynomials on Q, we can obtain an or- 
thonormal basis of 7t\(Q) with respect to the B-semi-inner product as 

i FY FY 

<Ai(x) := -, 1A2M := y 29(^1 - 2), ^ 3 (x) := J — (x 2 - 2), x := (xi,x 2 ) e Q. 

We choose positive coefficients {ak\\ =x as a\= a% = ch,:=\. Thus R(x,y) := 2t=i a k'l f k(x)i/fk(y)- 
According to Theorems l3.2l and l4.5l the Green kernel 

#(x,3>) := G(x,y) + R(x,y), x,y e 

is the reproducing kernel of the reproducing-kernel Hilbert space Hpg(Q) = t HQ(Q)@x\(Q) 
and its inner-product has the form 

(/. 8h"w '■= Cf. s)p.q + (/. gkaa. /, g e Hj^(S). 



Chapters 10 and 11] state that the native space N$(Q) of the thin plate spline 



covers the Sobolev space "H 2 (Q). Therefore Hif B (Q) g , H 2 (fi) C NAQ) 



Remark 5.2 We can also introduce other J-dimensional examples that connect Green ker- 
nels with, e.g., pdLg splines [12] or Sobolev splines [10]. A pdLg spline is given by a linear 
combination of the homogeneous Green kernel centered at the data sites from X. Thus it pro- 
vides the P-semi-norm-optimal solution of the scattered data interpolation problem. Accord- 
ing to Example 5.7 of 1101 . the Matern function (or Sobolev spline) 4> m .a- of order m > d/2 
with shape parameter <x > can be identified with the kernel <P m ,o-(x,y) = (p,„^{x - y) 
which is a full-space Green kernel of the differential operator L := (A - o~Tf. If we add 
nonhomogeneous boundary conditions to L then the finite set used in the present paper 
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does not allow us to discuss the resulting Green kernel €> mjJ and to check whether it is a 
reproducing kernel in a regular bounded open domain Q. This is done in the thesis 1 26 1 
where it is shown that for each cr the reproducing-kernel Hilbert space associated with <P,„ tCr 
is equivalent to the Sobolev space T-f'XQ). However, different shape parameters cr allow us 
to choose a specific norm for ^'"(Q) that reflects the relative influence of various derivatives 
in the data. 
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